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jarshall McLuhan has said tiiat the map is 
one of a select group of communications media 
without which "the world of modern science and 
technologies would hardly exist." Last year the 
Geography and Map Library in room 2N075 answered 
5000 geog raphic i nformation requests and 
furnished ] | -maps^ charts, and geographic 

publications to help...the employees of the Agency 
communicate more effectively and to help them 
adjust to the rapidly changing target areas and , 
international crises which characterize NSA's 
recent history. For those readers who have 
never used our services this photo'essay should 
provide an introduction to the selection of maps.. 

In selecting a map we usually ask custpmers 
to visit the Map Library because describing a ., 
map over the phone can be difficult. One of the 
first questions we usually ask is what scale 
map is wanted. This is a confusing question be¬ 
cause small can mean large and large can mean 
small. In other words, a small scale map covers 
a large area and a large-scale map covers a 
small area. Scales can run from 1:1,000,000,000 
(one to one billion), which would be a map of 
the world the size of a postage stamp, to 1:1 
(one to one], which you could get by putting a 
piece of paper on the floor, putting your foot 
on the paper and tracing around it. You woul<i 
then have a map of your foot at a sc ale of o ne 
to one■ Figure .1 shows three maps of[ 


Tile second major concern in selecting a 
map is the projection. Projection refers to the 
method used to put a representation of the earth 
on to a flat sheet of paper. Maps are usually 
projected onto cylinders, cones and planes. The 
following chart shows some of the major types 
and their uses. 


FAMILY 

NAFiE 

USES 

CYLINDRICAL 

MERCATOR 

Navigation and dead 
reckoning 

CONIC 

LAMBERT'S 

CONFORMAL 

Atlases, pilotage and 
radio 

AZIMUTHAL 

EQUIDISTANd 

Aeronautics, radio, 
engineering and 
celestial maps 

GNOMONIC 

Trans-polar and trans¬ 
oceanic routes, radio 
and seismic work 


FIGURE-.2 


EO 1.4.(c) 
PlL. 86-36 


[ in smalI, medium, and large scales. The 
squares on the 1:1,000,000 and 1:250,000 maps 
represent the area covered bv the 1:50.000 mao. 


Figures 3a through 3f show-xhow the human 
head would be represented in various mapping 
methods, revealing their respective distortions. 
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3a. Globular 


]P -;-^-j- ---- 





. ! 






Jb. Mercator 



FIGURE 3 


3c. Polyconic 


3d. Lambert* s Conformal 


= 


3e. Stereograpbjc 


jf . 

GnomonIc ] A f 


;i^i 


JflillllllllllllllllllllllllllUiiJIllllllllllllllllllllililllllllllTTj 

After the scale and projection questions 
have been solved, the major remaining problem 
is the type of features needed on the map. If 
you want a map to decorate your wall, a National 
Geographic Map with terrain features and many 
place names might be best. If you want to do 


plotting, an outline map would be best. Terrain, 
briefing, and outline maps come in three general 
siz.es: small, medium, and large depending on\ . 
the size of the paper the map is on, not the \ 
scale of the map. In general small maps are 
letter size and are good for including in SIG^NT 
and other types of reports. T he map shown in \ \ 
figure 4 is a medium-size map| T 

usually include a medium size terrain map with . 
small special inset maps covering population, 
economics, vegetation, ethnic groups, and other, 
relevant specialized subjects. The map library 
has these area brief maps for most of the coun- \ 
tries in the world. 
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FIGURE 5 


The last two figures cover special 
maps. In figure 5 you can see, if you squint 
real hard, a map taken from the National Geo- 
graphic Magazine which illustrates the world 
wide use of oil. The United States is very large 
and Africa and Australia are tiny. The map be¬ 
low the oil use map shows in an exaggerated way 
the world of known oil reserves. These maps have 
been used as an ad for awel1-known international 
oil company. These maps and the map from Forbes 
magazine, "Going Fishing in South Vietnam," 
which shows the oil concession zones in the 
South China Sea, illustrate the wide range of 
devices and distortions that maps employ to 
communicate and also the highly specialized 
nature of many maps. The Geography and Map 
Library has many examples of specialized maps: 
from maps which show oil pipelines, wells, 
pumping stations, etc., to bird hazard, whale, 
time zone,and ice charts to city and port plans 
to moon maps .f 


Figure 6 suggests the wave of the future 
as far as the production of many specialized 
maps is concerned. Computer plotting along 
with maps on microfiche and computer graphics 
will undoubtedly play a larger role for both 
geographers and Agency analysts. Of the exam¬ 
ples shown in the photo, the one on the extreme 
right, illustrating field-of-sight plotting, 
would pro bably be the most useful for Agency 
problems.I 


Maps on microfiche can be useful when it is 
necessary to trace the course of a railroad, 
river, or border area over a long distance. 
Successive sheets in a map series can be photo¬ 
graphically reduced and placed side by side on 
one fiche for easy visual continuity,.. . 


P.L. 86-36 
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As far as computer graphics is concerned,the 
Agency ajready ha s map programs on the following 
computer systems;I ^ own 


in conclusion, just remember to think o 
your map requirements in advance,then come o 
-down -and-.-vi-s-it -u-s-in -Room-2N0-7-S. -O-ur.. h.aurs. .a 
from 10 a.m. to noon and from 1:30 to 3:30 p 
Also watch for our disnlav at INFO 7S in Mar 




A.-^inguists, collectors, information technicians, SRA’s, and data systems people can all f 
articles in this issue of CRYPTOLOG dealing with their specialty. Somehow or other, there isn 
anytfiing for cryptanalysts. . . .or there wasn't anything for them until the Editor decided t 
fill this spot at the bottom of a page w'ith three open-code messages from the back of Militar 
Cr>T>tanalytics , Part I . Each of these texts contains some other meaning besides the obvious o 
Can you find the hidden message in each of these innocent-looking texts? 

1. TO COVER A.NJD HIDE YOUR FIN.VN^CES, I MAINTAIN STAFF TO BARTER FRANC EXCHANGE. 

2. BEARER IS A FRIEND. I CANNOT WRITE MUCH. WILL YOU BE READY TO MEET A TRUSTED INTERMEDIARY 
YOU CAN GIVE ALL NECESSARY DOCUMENTS TO HIM NEXT WEEK? I HAVE NOTHING MORE TO SAY. 

3. DISATISFIED WITH IMMIDIATE RESULTS OF YOUR .AMALYSIS STOP ADITIONAL REMUNERATION TO ALL 
PERSENNEL WTIO INDENTIFY COMPONANT PARTS OF THE ALLOIS OTHER THAN NICKEL OR COPPER. 


Sorry but we can't print the answers, since these problems are part of an extension 
. . .but vou crvnanies shouldn't have much trouble with them. 


course. 
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in QRL. The Quarterly ^ / 

Review for Linguists, Feb & Msy 71 

95lhe Revfewe 






text 


’The 


person who reviews the final English 


J There are several advantages to 


having all outgoing messages read by one person 

1) The reviewer serves as a control point 
for conventions of style, usage, technical no¬ 
tations, spelling, publication series, priori¬ 
ties (sometimes a message looks hotter after 
degarbling, and priority is marked up) • 

2) The reviewer can best control the 
quality of the translations and monitor the 
observance of standards. This is best done by 
a single person. 

.3) The reviewer, seeing all outgoing 
messages, is able to examine each one in the 
widest context possible. He can on occasion 
I I snot a duplicate 

translation which has slipped through the 
scanners unnoted. 



P.L. 
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4.Section Chief |‘ 

The determination of standards in general i 
and in detail is the responsibility of the 
section chief. He must therefore be qualified 
as a linguist. There are two principal ways ini 
which he is able to observe and thereby exer¬ 
cise control oyer the quality of the end 
product: 

1). He may receive the requests for clari- i 
fication of texts from the consumers and from 
editors within NSA and personally conduct the 
research required for these requests. 

2'] He may periodically check messages which 
have been translated and review messages which i 
have been checked. 

It is normally of interest to the section ; 
chief to read daily the top priority messages 
which have been disseminated by teletype and 
to examine them with the eye of a reviewer. 



In 1963 President Kennedy expressed his 
solidarity with the beleaguered people of Ber¬ 
lin by proclaiming, "Ich bin ein Berliner!" 

This was understood without difficulty on both 
sides of the Atlantic. But what if he had want¬ 
ed to express solidarity with the people of 
Hamburg-or still worse, Vienna? Americans might 
have been dismayed to hear the President call 
himself a Hamburger or a Wiener, for we are not 
always familiar with the forms that names of 
cities take to express citizenship. 

Even in English these may be unpredictable 
In the list below, can you give the correct or 
accepted English form for a resident of each 
city? (Answers on page 12.) 


1. Aberdeen 

13. Memphis 

2. Atlanta 

14. Moscow 

3. Cairo 

15, Naples 

4. Cambridge 

16. New Orleans 

5. Dallas 

17. Oxford 

6. Florence 

18. Parma 

7. Glasgow 

19. Peking 

8. Legh^n 

20. Rio de Janeiro 

9. Liverpool 

21. Shanghai 

10. Los Angeles 

22. Tangier 

11. Madras 

23. Trieste 

12. Madrid 

24. Warsaw 


(UNCLASSIFIED] 
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chief of P14, who is the individual most re¬ 
sponsible for the solution of a number of tar 
get callsign systems over the past 30 years, 
the first step you should take when faced 
with the job of solving a new and complex 
callsign system is to go on two weeks annual 
leave! 


VllLLUM J. JACKSON, PIA 


significant system characteristics and of 
phenomena useful in analysis. Severa l standard 
forms are available for this purpose.| 


Assuming' that the system is not immedi¬ 
ately obvious, the initial objective is to 
determine what type it is.] 


_I The better either 

you or the team does on continuity, the easier 
and more successful your callsign analysis is 
likely to be. In addition to the requirement 
of continuity for successful analysis, another 
is that of complete openmindedness in the 
approach to the problem: no idea, no suggestion, 
should be dismissed as being implausible. 
(Remember, Aristotle said that a likely im¬ 
possibility is always preferable to an uncon¬ 
vincing possibility.) 

Probably the best approach to callsign 
study, after a number of callsign continuities 
are available, is to arrange the callsigns in a 
form which will facilitate the recognition of 
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In forthcoming issues of CRYPTOLOG it is 
expected that one or more examples of the ap¬ 
plication of the foregoing approach will be 
presented. 



Mr. Craig's analysis|_ 


_^was a,valuable piece o|f reportage, and I 

personally enjoyed reading it and learned a lot from it. 

EO 1.4.(c) 


Thank you for a very fine new magazine. 


P.L. 86-36 


(Name withheld by request.] 
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Forming New SPECIAL INTEREST GROUP on 



Human Factors 


Jkvid you ever wonder. , , 

how many hours are wasted because analysts 
have to read output in "computerese'’ that 
borders on low-level encipherment? 

how many ACRP operators have trouble copy¬ 
ing traffic due to high noise level in the 
aircraft, or possibly have hearing problems 
from the noise? 

how many errors are made because of poor 
keyboard design or non-standard layouts? 

why your typing keyboard is so high that 
it gives you a backache or tired shoulders, 
or just feels uncomfortable? 

why somebody designed your operating con¬ 
sole so you have to stretch to reach the 
controls, or why they didn't give you 
enough writing space? 

how many computer jobs have to be rerun 
because the tape label was hard to read 
and the wrong tape was mounted? 

how long this list would get if you really 
thought about all the other problems we 
live with, day in and day out, because 
someone forgot to consider the human being 
in the working environment? 

Some of your colleagues have wondered, and 
are doing something about it. 

Under the sponsorship of the NSA Computer 
and Information Sciences Institute (ClSIj they 
are forming a Special Interest Group which will 
be called SIG/Human Factors. 

The Special Interest Group's goals are; 

To increase awareness of the need to con¬ 
sider human factors in our work, so that 
as systems and procedures are acquired or 
developed, (Ij people are considered in 
relation to the total environment--which 
means consideration of human physiological 
characteristics, behavioral reactions, bio¬ 
medical factors, training, motivation, 
personal comfort and safety, and (2) the 
highest and best use is made of both human 
and machine resources through assignment 
of appropriate roles to each. 

To stimulate NSA/CSS-wide interest, under¬ 
standing and involvement in the human 
aspects of our business. 


To promote a more efficient interface among 
people, hardware, software and environment 
in systems design, development and use. 

To encourage the acquisition and applica¬ 
tion of information, tools and techniques 
to satisfy the above. 

Through lectures, seminars, working groups 
and publications, SIG/Human Factors plans to 
provide opportunities to learn more about the 
human element in procedures and bring people 
with common interests and problems together on a 
professional level. 

_ Under the general guidance of[ H 

I I CAbS, ext, 3847], who initiated ac- 

tions to start the SIG, the nucleus of the group 
presently includes I \ 


\ _|Jack Gurin (P16, ext. 5236). 

Until the Group is more formally organized, 
these people are key points of contact. If you 
are involved in human factors work or are a user 
with a strong interest in how systems and pro¬ 
cedures design affects you or your subordinates, 
please get in touch. We.need your support. 

As of now, commit yourself to a Vigilance 
Task Cthat's a good human-factors buzz word)! 

The task is to keep a watchful eye on your daily 
mail for notices of SIG/Human Factors activities, 
which shou ld be starting soon. _ 

NO PAGE 19-20 IN NOVEMBER ISSUE 


»ou may have noticed that the Table of 
Contents for the November CRYPTOLOG listed "A 
Medal for Horatius" on page 19 and a Letter to 
the Editor on page 20. You may also have noticed 
that your copy didn't have pages 19 6 20 in it. 
It seems that the writer of the letter included 
some terminology and information that were bet¬ 
ter left unpublished in a general newspaper. 
Alas, the breach was not realized until the 
issue had been printed.so in the inte¬ 

rest of security the offending page was bodily 
removed. The letter (duly sanitized) will be 
found on page 9 of this issue and the Golden 
Oldie about Horatius* medal will be included in 
CRYPTOLOG sometime soon. (UNCLASSIFIED) 
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The Collection Career Panel has now in 
draft a new set of criteria for Professional¬ 
ization. The new criteria are to be published, 
we hope, in January 1975. Some description of 
the new criteria will be found below, but for 
now, let us just say that they are more 
pertinent, 

When the new criteria are published, aspi¬ 
rants who have already submitted Professional 
Qualifications* Records (PQR's) will have a spe¬ 
cified amount of time from the publication date 
to achieve certification under the existing 
criteria. The new criteria will contain some 
rigid requirements--some specific demands -- not 
found currently. At the present, it is not easy 
to be a professional Collector; in the future 
it will be more difficult. At the present, 
training requirements may be met by peripheral 
courses and on occasion credit must be given 
for courses of very little relevance to the Col¬ 
lection business. The criteria to be published 
will afford points for any training or edu¬ 
cation, as before, but will require some spe¬ 
cific Collection-related training as well as 
requiring some additional training from a set 
of ’'elective" courses. The specifics of the 
training requirements have not been agreed on 
entirely, but the basic concept will prevail as 
will most of the training required in the draft. 

From a purist's point of view, the new 
criteria are exemplary concept. There will be 
two professional areas: Collection Specialist 
and Collection Officer. 

Dec 74 


The Collection Specialist will be concerned 
primarily with Collection operations and it is 
intended that certification in this specialty 
will enable the individual to be promoted in 
professional-level assignments through grade 
GG-13. 

To be certified as a Collection Specialist, 
an aspirant nsust have amassed 1,000 points, must 
have met certain minimum standards (including 
having taken some specific training courses), 
and he must have passed a Professional Qualifi¬ 
cation Examination. While academic education is 
always an asset in any professionalization sys¬ 
tem, technical training and achievements are 
stressed for a Collection Specialist^with aca¬ 
demic education a very desirable adjunct. The 
emphasis for the Specialist is on technical 
competence. 

The Collection Officer will be, as he is 
now, more oriented toward staff and management. 
The criteria for him will include certain mini¬ 
mum academic education requirements and some 
different required training courses, and some 
of the other minimum point requirements may be 
higher. Many of the basic requirements will be 
the same for the Collection Officer as for the 
Collection Specialist, so that the points earned 
in achieving certification as a Specialist will 
go a long way toward certification as an Offi¬ 
cer, but it may be possible to become a Col¬ 
lection Officer without being able to qualify as 
a Collection Specialist. The normal progression, 
however, will probably be for an aspirant to be 
professionalized as a Specialist first. 
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Besides the add^ition of academic education 
requirements for the Collection Officer, he too 
will be required to pass the PQE. Further, he 
will also have to pass an oral examination 
board. lYhen the aspirant has met all the mini¬ 
mum requirements, has passed an objective 
written qualifying examination, and has then 
been subjected to a further screening by an ex¬ 
amining board, he will have demonstrated real 
professional competence. The new criteria will 
not be more difficult than those in existence 
now, probably, but they will be more rigid, more 
specific, more demanding. They will be focussed 
more sharply on Collection and in many ways will 
be more objective. This writer feels that they 
will be a vast improvement. 


ed for the career field. With the advent of the 
new criteria, a definite plan can be drawn, a 
career can be mapped out in Collection from the 
beginning. A potential professional Collector 
can be groomed and be guided by the criteria 
through a career from the time he enters on 
duty. Those of us elderly personnel who have 
floundered and drifted through an entire career 
can appreciate how much that could mean. 

And let it be said one more time: The Col¬ 
lector is the backbone of the SIGINT system. 
Without him there is nothing for the other dis- 
iciplines to work on..We need competent, pro¬ 
fessional Collectors, and through the new 
criteria, we will develop them. 


, One of the chief benefits to be derived 
from the proposed criteria is that, for a very 
welcome change, a curriculum is being establish- 
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ENGLAND: Some messages sent in 1910 from a sea captain to Scotland Yard 
—marking the first time that radio was used to capture a 

criminal—were auctioned off in London recently for about $4,000. Those messages led 
to the arrest of Dr. Hawley Crippen who left the dismembered body of his wife in the 
basement of their London home while he and his girlfriend went for a cruise to Canada 
aboard the liner Montrose . The captain became suspicious and used his ship-to-shore 
radio to ask Scotland Yard for advice. 

A British boxing fan who was hoping for a son has given his new daughter a name 5 

involving the surnames of 25 heavyweight boxing champions and for the rest of her 

life the girl will have to fill out forms with: Maria Sullivan Corbett Fitz- 

Simmons Jeffries Hart Burns Johnson Willard Dempsey Tunney Schmeling Sharkey 

Camera Baer Braddock Louis Charles Walcott Marciano Patterson Johansson Liston Clay 

Frazier Foreman Brown, How did "Maria" get in there? \ 

^ British males made sterile by vasectomy operations have begun wearing neckties^ 

W'^rw ^ special "V" motif, originally designed to promote the operation, but according 

yA\]\ to an official of the Vasectomy Advancement Society, many men who have not had the 
^ ^j operation are placing orders for the ties. 
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l^^Pntil six months ago I considered myself One of the other programs failed and after 

a competent programmer, but since writing a two weeks of looking at the program I found out 

recent series of data handling programs I’ve that the analyst had combined two tapes onto 

had to revise that opinion. The programs be- one and input that one to my program. This in- 

haved well when being written and initially troduced duplicate records and separate blocks 

debugged, but got rowdy after being given to an of the same key, and thoroughly confused the 
analyst for routine use. program and me. 


job I tackled was to write a family of pro¬ 
grams, one for each key system, to sort the key 
by identification, eliminate duplicate records, 
and add the newest data to a blocked tape. This 
tape would then contain all known key on that 
system, in a prescribed order. 

The analyst who was to use the first pro¬ 
gram gave me the following information about th< 
input data: 


It only takes one wrong record to derail a 
program, and unless that record is flagged at 
J:he time, ypu may find yourself searching 
through thousands pf records without knowing 
what to look for. When an.analyst tells you 
"All of the data has these characteristics" try 
to remember the wise old saying: ■’Statements / 
that use ’ always ' or ’ never ’ are always falsep" ^ 

Programmers can gain more yardage by eO 1 
having the computer act as referee. At each 
point where "unnecessary roughness," ^ 

"offsides," etc., can occur, include jbX 


86-36 
4. (c) 



Taking the given information with a simple 
(minded) faith I proceeded to write programs 
to do the job. 

The first time the analyst brought back 
one of the programs it took me a week to dis¬ 
cover that the failure was caused by missing 
separators between the lane groups in the input 
tape. I had not thought to look there. 

The second time she brought it back I 
analyzed the program logic for another week 
before I noticed that the segment numbers on 
the input tape were not in the proper order. I 
added a sort step to the program. I 


the following: 

a. A statement of what is wrong ^ 

with the record; L 

b. A printout of the records that 

were being processed when the flag was tJ 
thrown; and / 

c. A branch to read a new record 
and continue processing. 

This technique should help both in 
initial debugging and in planning later 
revisions. 

I'll just run it up the flagpole and 
see who salutes it, _ 


WANT AD 


WANTED: Unwanted RYE GUPPY Manuals. If you have 
a Manual in good f-nnHi i-i nr. longer need it 

please send it to _ E13, FANX 2, 

for use in Cryptanalysis training courses. 
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rogram Exinternei 


PART FOUR: WHAT HAPPENS TO THE GRADUATES? 


_^people have graduated from the 

intern program to date. What impact have they 
had on the work force? Is their performance 
notably different from that of college hires 
who took and remained in direct assignments? 

How do graduates feel about an Agency career? 

How do they feel about the intern program? While 
I have heard much concern about what would hap¬ 
pen to college hires if they were required to 
have operational experience before being con¬ 
sidered for an intern program, there seems to 
be relatively little concern about what happens 
to the graduates, and little effort directed at 
looking at the program through their eyes. 

One panel did conduct a survey of graduates 
several years ago and found that approximately 
20% of the graduates were having problems with 
their assignments and that the primary problem 
was lack of challenging work. There are two 
ways to look at the results of that survey--one 
is to say that the hands of those graduates 
were held for three years and if they encounter 
problems now they should be resourceful enough 
to know how to handle them. The opposite ap¬ 
proach is to say that after spending thousands 
of dollars on classroom and on-the-job training 
for these people, it is foolish not to have 
some type of follow-up program to ensure that 
they are being usefully employed and to monitor 
their careers in order to keep abreast of pro¬ 
blems that seem to be common to a number of them. 

In fact, there do seem to be some patterns 
in the careers of that panel's graduates that 
would concern me if I were a Panel member or an 
M3 employee. The survey cited above revealed 
that sex and group assignment seemed to have a 
very significant bearing on career advancement. 
For instance, at the time of the study 14% of 
the graduates either had been assigned to Group 
X by the Panel or had transferred there and 17% 
of the graduates had been assigned to Group Y 
or had transferred there^but 57% of the pro¬ 
motions received by that Panel's graduates went 
to those in Group X and not one of the Group Y 
graduates had been promoted. If I were a Panel 
member, I would want to know if Group Y really 
had appropriate jobs for their graduates. Pro¬ 
motional opportunities also seem to have a 
sexual bias: 46 women and 43 men had graduated 
from the program as GG-ll's. At the time of the 


study, six graduates had been promoted to 
GG-12; they were all men. Sixteen months later 
the grades of the first five classes this panel 
graduated were reviewed. By that time 17 of the 
graduates were 12*s; 14 of them were men. 

While the Agency reorganization made it diffi¬ 
cult to continue an organizational analysis, it 
was possible to determine that Group Y had yet 
to promote a graduate. 

These findings suggest that the most sig¬ 
nificant indicator of a graduate's future ad¬ 
vancement in this career field may be his sex^ 
and that Group assignment is also a significant 
predictor; however, on a theoretical level 
Career Qualification Battery scores are used 
to predict success in a career field. How did 
the CQB scores of the graduates who were pro¬ 
moted compare to those not promoted? Scores of 
57 graduates who remained in that career field 
from the first five classes the panel graduated 
were analyzed. For the 20 graduates who had 
been promoted to either GG-12 or GG-11 as of 
December 1973, the average CQB score in the 
category that pertained to their career field 
was 5.25. The average score of the 37 graduates 
not promoted was 5.64. I said previously that 
if I had faith in CQB scores as predictors of 
success and viewed the program as a highly se¬ 
lective one, I would require a higher score 
than the 5 that most panels currently require 
of program applicants since a 5 indicates aver¬ 
age test performance. Actually, what the Panels 
may be expressing by not requiring a higher 
score is that they do not have such faith in 
CQB scores. In the case of this panel the re¬ 
quirement for a 5 was not even enforced for 15 
of the 57 graduates; if it had been adhered to, 
almost half (9 of the 20) graduates who have 
been promoted would not have been accepted into 
the program. Three of those nine did not even 
receive a score of 4 and thus needed a waiver 
since they did not receive a qualifying score 
for the COSC. On the other hand, only 6 of the 
37 not promoted (16%) did not receive a score 
of 5 or above and only one of those 6 did not 
receive a qualifying score for the COSC. While 
these are admittedly very small samples, these 
figures make me uneasy when I consider how much 
emphasis is placed on CQB scores in determining 
which employment applicants will be hired, and 
then what fields they will enter. 


P.L. 86-36 
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That uneasiness prompted me to do some 
further research into CQB scores. I next com¬ 
pared scores of 60 interns, 30 with a degree 
and 30 without a degree for the category that 
pertained to their career field. In view of the 
recent proposal that the program again be lim¬ 
ited to college graduates, I was impressed by 
the fact that the average score for non-college 
graduates [6.46) was higher than that of the 
college graduates (5.87). That difference in 
average scores may suggest that performance on 
the CQB could be affected by experience even 
though, with an aptitude test, this should not 
be the case. This theory received additional 
support from the test records of 8 on-board 
interns who took the CQB twice. Their two 
attempts yielded a total of 206 scores so 103 
comparisons of scores could be made. Scores 
improved by 1 to 5 points in 56 cases, stayed 
the same in 26, and dropped in 21. Given a 
universal requirement of 5 for consideration 
for an intern program, these people would have 
gained eligibility in 20 categories and lost 
eligibility in 8. The most dramatic change was 
an applicant who went from a 3 to an 8, going 
from a score that was too low to even be con¬ 
sidered for the program to a score that made 


B., L. 8 6-36 


him a prime candidate. The possibility that the 
first day was just a bad testing day for this 
individual is diminished by the fact that scores 
for 4 of the categories remained constant. 

Another thing about the CQB that disturbs 
me is that the CQB battery seems to have changed 
little, if any, in the nine years since I first 
encountered it, although some career f ields have 
changed considerably during that time.I 


_I the 

SR field has attempted to assert its identity as 
a definable career field rather than a catchall 
for people who do not seem to fit into any other 
field. Does the present CQB, and the weights 
given the various subtests, adequately reflect 
this, or is the battery a selection tool that 
was appropriate for the fields ten years ago but 
not today? 

My discussion so far applies to just one 
panel- The study that was done by the specially 
designated Intern Study Task Force provides a 


EXTRACT FROM TABLES 

Graduate interns 1969 and 1970 

CA DATA LANG. TA SR 

SYSTEMS 


Number of interns 
Grade: GG-9 
GG-11 
GG-12 
GG-13 

Not Promoted Since 
Graduation 

Last P/A Outstanding 

Overseas Tour 

Resignations 


/P . L. 


86-36 


FOOTNOTES 

The categories of “Number of interns" and “resignations" were not defined but it appeared that “number of 
interns" referred to graduates who were still at the Agency and did not include graduates who have resigned 
since the sum of the figures in the grade breakdowns equaled that given for “number of interns.” (The one 
exception to this was the SR Panel for which “Number of interns" appeared to equal the figures from the grade 
breakdown plus resignations). Therefore, to determine the total number of graduates I added “number of interns" to 
“resignations.” This total was used only for the attrition information. 

|,EO 1.4. (c) 
■p.L. 86-36 
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broader look into the fate of the intern pro¬ 
gram graduates. When I first looked at one of 
the studycharts, part of which is given 
above, I didn^t see much of interest. However, 
I then used the data provided as the basis for 
additional computation and some interesting 
patterns began to emerge. 


It should be noted that these figures are lower 
than those contained in an FY74 Management Re¬ 
port. The difference may be due to varying de¬ 
finitions of attrition which will be discussed 
later.) 

If I were an Agency manager and saw these 
charts I would want to know: 


The information provided above yielded the fol¬ 
lowing statistical information: 

A. Percentage of Graduates Promoted by Career 
Field 

DS- (57.5%) 

TA- (33.3%) 

LG- (33.3%) 

CA- (23.6%) 

SR- (17.2%) (These j^aduates were at a disadvanta^ 
since the first SR interns did not graduate until 1970. 
while other panels graduated interns in 1969.) 

B. Percentage Promoted by Career Field and Sex 


DS-M (66%) 
LG-M (58.5%) 
TA-M (50%) 
DS-F (39.1%) 
CA-M (37.5%) 


SR-M (22.5%) 
CA-F (12.9%) 
( 11 . 1 %) 
( 8.3%) 
( 0 %) 


SR-F 

LG-F 

TA-F 


C. Percentage Receiving Outstanding Performance 
Appraisals by Panel 
TA (86.6%) 

LG (50%) 

DS (47.9%) 

SR (46.5%) 

CA (27.2%) 


D. 


Percentage of Outstandings by Sex and Career 
Field 


TA-M (90%) 
TA-F (80%) 
LG-M (58.3%) 
SR-M (54.8%) 
DS-M (50%) 


DS-F (43.4%) 
LG-F (41.6%) 
SR-F (37%) 
CA-F (29%) 
CA-M (25%) 


E. Percentage of Graduate Resignations by Panel 
TA (44.4%) 

LG (33.3%) 

CA (15.4%) 

SR (15.4%) 

DS (1.4%) 


F. 


Percentage of Graduate Resignations by Sex 
and Career Field 


TA-F (54.5%) 
LG-F (42.8%) 
TA-M (37.5%) 
CA-F (22.5%) 
SR-F (20.5%) 


LG-M (20%) 
SR-M (6.1%) 
CA-M (4%) 
DS-M (2%) 
DS-F (0%) 


(To give additional perspective to these figures, 
the statistics on resignations of interns in 
the program, from its inception through the 
first quarter of FY75, were analyzed using an 
M3 report. The figures for these five panels 
were clustered between a low of 24.8% for CA 
interns and a high of 29.3% for Language interns . 


1. How do the figures for intern attrition in 
these fields compare with those for non-intern 
attrition? How do they compare with the figures 
for college hires who took direct assignments? 

2. How many of these interns had prior crypto¬ 
logic experience? I would be especially inter¬ 
ested in this figure for the TA field. If those 
with prior experience do have better attrition 
records than the liberal arts graduates, as I 
suspect, why don’t we concentrate on hiring them 
for fields like TA? 

3. Has a study been done of the interns who 
resigned? Do college hires with certain majors 
and personality profiles tend to leave as I 
suggested previously? 

4. We have heard much about the loss of data 
systems personnel once they have received some 
Agency training; however, the '69-70 data systems 
graduates had the lowest attrition rate at the 
time of this study, and at that time these 
graduates had been with the Agency for up to 
eight years. Is their graduate attrition rate 
the direct result of having the highest promo¬ 
tion rates? Is there a leveling off that takes, 
place—do those who stay here five years tend to 
make their careers here? Or has the attrition 
rate for data systems graduates changed for the 
worse in recent years? One C Group manager told 
me of his idea to try to establish a model 
based on the past attrition of data systems 
personnel and changes in the nation's economy. 
Such a model could possibly alert Agency man¬ 
agers to an impending large-scale loss of data 
systems personnel. Did such a model ever become 
a reality? 

5. Is there a logical explanation for the fact 
that the resignation rates for interns while in 
the program are closely clustered, as among the 
various fields (24.8--29.3%), but resignations 
of graduates show wide variation (1.4--44.4%)? 

6. Why is there little relationship between 
the panel rank order for promotions and the 
one for outstandings? Is it much harder to get 
an outstanding if you are a cryptanalyst than 
if you are a traffic analyst? Why do female TA 
graduates have the second best percentage for 
receiving outstanding performance appraisals 
but not one of them had been promoted? Why is 
it that the performance appraisal percentage 
for the female CA gradiiates is better than that 
for the males but the reverse is true for their 
promotion percentages? Is it true that women 
are given outstandings while men are given 
promotions? 
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7. Why is it that only 2 of the 19 field as¬ 
signments received by intern graduates have 
gone to women? I suspect that some people would 
reply ’’Because women aren't interested,” Then 
isn’t it interesting that 2 of the 5 TA women 
graduates have field assignments? What was so 
different about those women compared with the 
other female graduates? 

8. 'I strongly suspect that if the study had 
shown promotions received by organization there 
would have been biases across the board just as 
there were in the study that the one panel con¬ 
ducted. Are such biases of interest to M, the 
Panels, or Agency managers? 

9. Is it of interest to M3, the EEO office, or 
Agency managers that the promotion figures show 
the most sexual segregation and that the male 
graduate who statistically has the worst chances 
for promotion still has a better chance than 
every woman graduate except those in the data 
systems field? 

I think it is unfortunate that studies such 
as this one usually stop short of looking for 
cause and effect relationships and thus are not 
as meaningful as they should be. In this study 
I think some of the questions asked were too 
vague to allow the task force to do this type 
of analysis. For instance, if I were one of the 
supervisors who was asked ”Is there a difference 
in the work performance of an on-board intern 
graduate compared with a college campus intern 
graduate? ”I would ask that the categories be 
broken down further. Maybe I would take a col¬ 
lege hire with military experience as my first 
choice, an on-board college graduate as my 
second choice, an on-board intern with no de¬ 
gree but related military experience as my 
third choice, a direct college hire as my fourth 
choice, etc. 

I was also concerned by the type of ques¬ 
tion that intern graduates were asked. Perhaps 
the originators of the study did use some grad¬ 
uates as a sample before administering the ques¬ 
tionnaire but such a review was not evident in 
the final questions. Most of the ten questions 
were of an opinion nature e.g. ”Is there a 
continuing need for an Intern Program in your 
career field”? While the answers to such ques¬ 
tions are certainly of interest, as an intern 
graduate I felt there should be managers better 
qualified to supply an informed answer than I. 

To me, the value of asking intern graduates to 
compare their performance with that of non- 
intems is also dubious and I question the 
wisdom of using such subjective questions as 
part of a study that was designed to determine 
if the intern program should be continued. 

If subjective questions are used they 
should be followed up by facts and figures. In 
this case, would facts and figures support the 


subjective opinion included in the study? In 
comparing job performance, the majority of 
graduates felt that their job performance was 
more effective than that of their non-intern 
peers. Since I wasn’t able to compare effective¬ 
ness of job performance, I compared the grade 
levels of intern graduates, current on-board 
interns, and college recruits who took and re¬ 
mained in direct assignments for one career 
field. In doing this I reasoned that there 
should be a relationship between job effect¬ 
iveness and grade level even though previous 
research indicated an organizational and sexual 
bias associated with promotions. 

I established the following parameters for 
determining who would be in my sample to insure 
that the people I was comparing would, in fact, 
be similar: only employees who had a degree, 
were born in or after 1942, did not have more 
than 12 months difference in their Agency and 
government service computation dates, who still 
held a COSC for that career field, had not been 
an intern in another career field, and were not 
assigned to a group that contained only intern 
graduates or only direct hires. Since the in¬ 
tern program is described as a highly selective 
program, I envisioned that I would be able to 
find several employees who had been given direct 
assignments for every intern graduate; there¬ 
fore, I was surprised when I found 31 intern 
graduates and 15 current interns but only 29 
direct hires who fit these parameters. The 
selectivity ascribed to the program and the fact 
that the original interns had received two vir¬ 
tually automatic promotions also made me suspect 
that the intern graduates would have a grade 
edge, but an analysis of the grades of these 
three groups revealed a very mixed picture. In 
general, the employee with the highest grade of 
a group that started in a particular month could 
be either an intern graduate or a direct hire; 
the honor never went to a current intern (it 
should be noted though that interns can not be 
promoted above GG-llj. I noticed that when I 
reached employees who have been at the Agency 
for 66 months or less that the Agency-wide 
shortage of promotion funds tended to produce 
an equalizing effect but, interestingly, four 
of the five people who have been promoted from 
that group were direct hires; the fifth was an 
intern graduate. The lesson for on-board em¬ 
ployees considering entering the program ap¬ 
parently is that if promotion is a major 
concern, they will probably do just as well, 
if not better, staying in an operational as¬ 
signment --particularly if money remains tight. 

Until now I have not made any reference to 
the attrition rate for women as compared with 
that of men. I still hear supervisors voice re¬ 
luctance first to hiring and then to giving ad- 
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vanced training and promotions to young women, 
giving as their reasons that the women are 
likely to marry and then leave the area or be¬ 
come pregnant and resign. It is no longer valid 
to use such arguments, I also suspect that in 
many cases a baby may not actually be the prime 
cause of resignation, but its arrival represents 
a socially acceptable reason to leave a job with 
which the individual may have been disenchanted 
for some time. In fact, I wonder how many men 
would elect to stay in their current jobs if 
at some time between the ages of 25 and 35, they 
were placed in a position where the social pre- 
sure they received was to resign rather than 
stay on the job and when they were in a position 
where they knew statistically that their chances 
for success were considerably lower than those 
of their counterparts of the opposite sex. 

Motherhood doesn't necessarily make a woman 
less interested in an Agency career provided she 
believes that she has a chance of advancing in 
that career. It is disturbing to me that the 
female intern graduates may be suffering from 
the same types of handicaps as far as advance¬ 
ment is concerned that women in previous eras 
did. I had hopes that since the intern program 
gave men and women the same training, work ex¬ 
perience, and promotional opportunites, that 
this equality would carry over into their post 
graduate years. 



Footnote on program statistics: In my research I encoun¬ 
tered several problems of definition which M3 and the 
Panels must also have encountered. For instance, how do 
you define terms such as “graduate of the program" and 
“attrition"? In the past some panels classified anyone who 
completed the program as a graduate whether he achieved 
certification or not, while other panels apparently consid¬ 
ered those who completed the program but were not certi¬ 
fied as “transfers out." 1 indicated previously that the 
figures on intern resignations In one M3 report differed 
;rom the figures on intern aMrltion in another report based 
on M3 input. The explanation may be that "attrition" in¬ 
cludes more than resignations in one case but this was not 
evident, f can think of several types of attrition figures ! 
that would probably be of interest in reviewing the program: j 
A. Program attrition: How many people w'ho enter the pro¬ 
gram complete it? This would include transfers out and 
resignations but only those people who resign during their 
internship. This could be further broken down in several 


Conclusion : 

Much of what I have said really concerns 
one central issue: Is there a well defined phi¬ 
losophy behind the intern program as well as 
other Agency programs and practices? By "well 
defined," I do not mean fixed; in fact I do not 
believe that anything should be considered 
exempt from change, but just as the data systems 
analyst documents a program he writes, there is 
a need to document personnel practices. Because 
of frequent changes in administration and a 
lack of such documentation, there is a tendency 
for Agency personnel to continually "reinvent 
the wheel." In the case of my article, I real¬ 
ize that few of the ideas are unique; even so, 

I was somewhat surprised when, while working on 
this month's installment, I came across an 
Agency Management Report that included these 
questions: 

Are college graduates needed for 
all the jobs that these individuals are 
now on? Are some college graduates be¬ 
ing put on the wrong jobs? Is the Agency 
hiring more college graduates than it 
needs? Is there such a thing as an ideal 
NSA type that perhaps should be recruited? 

These questions sounded much like some that ap¬ 
peared in my first installment, but they were 
contained in an October 1961 report. 

Were these questions answered in 1961? If 
they were, and the answers were documented, and 
readily available maybe I would not have re¬ 
peated the questions in 1974. Or perhaps on the 
basis of the documentation provided, I could 
have seen that those answers seemed appropriate 
for the Agency in 1961 but not in 1974. 


ways such as direct hires vs. on-board interns, college 
graduates vs. non-graduates, etc. B. Current intern resig¬ 
nations: what percentage of inters leave the Agency dur¬ 
ing their internship? C. Graduate attrition: What percentage 
of graduates are left to mark five or ten years at the 
Agency? (This assumes there is a method of identifying 
intern graduates; in the past there has been no systematic 
way of doing this) D. College hire attrition: This could also 
be broken down into sub-categories such as college hires 
who go directly into the intern program, who take and re¬ 
main in direct assignments, and who become on-board in¬ 
terns. E. Career Field Attrition; The purpose of the program 
is to supply professional level employees for a specific 
career field. How many graduate interns leave the field 
within a year after graduation, five years after? 

Which of these categories, if any, do the attrition fig- 
gures compiled by M3 fall into? Without precise definitions 
for terms such as "graduate" and “attrition,." statistics 
on the program using such terms are of questionable value. 
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It is natural for a new manager to want to 
leave his mark on a position, but in his at¬ 
tempts to do so it is possible that he may 
institute a program very similar to one that 
failed five years before. All too often the 
employees concerned and the administrator's 
successors do not know whether a change was 
made for philosophical reasons, budgetary rea¬ 
sons, for the sake of change itself, or simply 
as a display of power. The changes I am refer¬ 
ring to affect virtually every aspect of Agency 
employment, including hiring, training, course 
content, criteria for professionalization, 
reorganizations, and relocations. 

Such documentation would be extremely valu¬ 
able in program evaluation. It appears that 
there are often two sets of goals for a program, 
those that are written and those that are under¬ 
stood. There is nothing in the 1973 Intern Pro¬ 
gram Study to indicate that one of the primary 
motivations for establishing the intern program 
was to reduce the attrition rate of college 
hires, but if you ask an M3 employee to evaluate 
the effectiveness of the program, reduction in 
attrition is likely to surface as a major moti¬ 
vation for starting the program and as a signi¬ 
ficant accomplishment of it. (Attrition has 
dropped from the 65% reported for college hires 
in a 1961 management report to the 30% reported 
for interns in an FY74 management report.) If 
this was a primary goal, maybe continuation of 
the program would be justified on the basis of 
that reduction even if none of the graduates 
were certified; but then attrition statistics 
should be a factor in program evaluation, and 
every effort should be made to determine how 
much of the reduction in attrition can be 
credited to the program and how much to other 
factors, such as a change in the economic 
climate of the country. 

It also seems appropriate to ask; Would 
there have been other equally effective ways 
to reduce attrition? Is there a point at which 
the reduced attrition no longer justifies the 
cost involved? Is there a point at which it 
becomes counterproductive? I suspect that the 
Agency attrition rate would be even lower if all 
new hires were started as a GG-9 and guaranteed 
a GG-11 30 months later, but it would be lower 
for the reasons alluded to previously; the re¬ 
cruits, good or bad, would soon reach a point 
where they felt they could not afford to resign. 

A look at the orientation of new college 
hires illustrates another need for documenta¬ 
tion. Currently there is a 9ls-week orientation 
course for new uncleared hires, but cleared 
hires are available for assignment immediately 
--usually on their third day in the Agency. My 
questions concerning this course are: is its 
primary purpose to give new hires an orientation 
to the Agency or simply to keep them occupied 
while processing their clearances? If the goal 
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is to give them an orientation, and if it has 
been determined that 9k weeks is the amount of 
time needed for that, then every new hire, 
cleared or uncleared, should have the course. 

If the number of new hires dwindles to a pre¬ 
cious few (as it did several years ago) other 
provisions should be made for the orientation, 
but the reason for discontinuing the formal 
course should be documented so that 10 years 
hence officials at the School, in M, and else¬ 
where will know whether the course was dropped 
because it was considered unnecessary or in¬ 
effective or because of cuts to the E budget. 

On the other hand, if the primary purpose of the 
course is to keep the new hires occupied and 
9k weeks is not really needed to orient them to 
the Agency, then it is reasonable to expect that 
cleared hires would be placed in a more concise 
course. If the number of people not cleared 
soon after completing that course grew to be a 
substantial one, it would also be reasonable to 
reinstate LIC working areas rather than contin¬ 
uing with the self-study courses that comprise 
the second portion of the present CY006 course. 

I suspect that the School already has machine 
records on courses , so perhaps the documentation 
I advocate could be done by simply inserting 
in existing programs a few comments about why 
courses were instituted, modified, or dropped. 

Similarly the contents of the panels* 
annual reports could be adapted to provide for 
some philosophical consistency both within and 
between panels. This could save the panels from 
having to learn the same lessons independently. 
For example, in its original criteria Panel A 
stipulated that an aspirant could not take the 
PQE more than three times. When an aspirant 
vouched for by his supervisor as a very valuable 
employee, failed the test for the third time the 
Panel was in a quandary; the authors of the 
criteria had not included any ideas on what was 
to become of such people. The Panel concluded 
that it was not practical to limit the number 
of times an aspirant can take a PQE. About a 
year later Panel B published revised criteria 
in which one of the new features was a three¬ 
time limit on taking the PQE. Now it has ap¬ 
parently learned the same lesson as Panel A and 
recently removed the limit. Why wasn't the first 
panel's experience sufficient to keep the second 
from having to go through the same educational 
process? While the panels' annual reports are a 
means of sharing findings, and panel A's change 
in criteria probably was included in its report, 
in order to be of value to other panels and to 
successor members of the same ones, the announce¬ 
ment of changes in criteria should include the 
rationale behind it. 

Once steps have been taken to explain the 
philosophy behind the intern program and other 
programs, the next step is to encourage dis¬ 
cussion of them. I am not advocating "manage¬ 
ment by the masses," but I believe that keeping 
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employees informed is beneficial to al 1 concerned 
and that every employee should be encouraged 
to comment on program features, to suggest im¬ 
provements, or simply raise questions. I am not 
talking about a hot line to handle complaints, 
but a ’’philospher's comer" in Cryptolog or 
Spectrum , where you might find an article com¬ 
posed of the views of an operational employee, 
an M3 employee, an intern graduate, and a cur¬ 
rent intern on what the goals of the intern 
program are and whether they are being met. Or 
an argument for specialization by an employee 
who has only strayed from his 20 year associ¬ 
ation with one problem for the six months need¬ 
ed for certification, side by side with an 
argument for diversitication by someone who has 


been with the Agency for 20 years and never 
spent more than two years in one place. Such a 
column might alleviate the feeling that many 
people have that the system has become more 
important than the people it was supposedly 
designed for. 

1^11 conclude my contribution to such a 
philosophical discussion by saying that it was 
not my primary goal to win converts to all my 
beliefs, but I did hope to start people thinking 
about many facets of the program and asking 
which ones are good, which should be modified, 
and which eliminated. I hope that current and 
graduate interns as well as non-interns will 
now take up the discussion. 


A prap 0..1 te ®alBniiarllefor«w 


1 ) 

jAJ^hen Julius Caesar introduced his calendar, 
he designated every fourth year as a leap year, 
the extra day being February 29th, as at present. 
However by the 16th century it became evident 
that there had been a few too many leap years, 
since their purpose, of course, had been to syn¬ 
chronize the calendar year and the earth's 
annual revolution around the sun. It seemed that 
there had been about three leap years too many 
for every period of 400 years. Thus at that 
time there had accumulated about 12 extra calen¬ 
dar days. 

In 1582 Pope Gregory XIII proposed that the 
accumulated extra days be dropped all at once 
and that thenceforth all calendar years ending 
in 00 C^xcept those divisible by 400) consist of 
365 days and therefore not be leap years. (Fol¬ 
lowing this rule, 1900 was not a leap year.) 
Summarizing: every period of 400 years would 
have only 97 leap years instead of the 100 that 
Julius Caesar had envisioned. Since 97 X 366 
+ 303 X 365 is an exact multiple of 7, each of 
these periods of 400 years begins with the same 
day of the week. 

There was general chaos, confusion and 
turmoil for several centuries, as each country 
found it expedient or necessary to come into 
line with the new Gregorian calendar. The United! 
States, for example, did not adopt it until the 
time of the American Revolution, and then only 
after a long struggle. As great an improvement 
as the Gregorian calendar is over the Julian 
calendar, there will nonetheless be an accumula¬ 
ted error of one day after 3,200 years. I believe 
the turmoil that might occur at such a time can 
be avoided. 




If Pope Gregory had had a large computer 
in his basement, he would have noted that by 
merely excepting every year exactly divisible by 
128 from the Julian leap year rule, he could 
have had at once a simpler and a far more accu¬ 
rate calendar. Instead of 97 leap years every 
400-year period he would have proposed 31 for 
every 128-year period. Oddly enough, this 
leaves 97 normal years. (The number 128 is 
two to the seventh power, or 10 000 000 in 
binary notation. This may or may not be of 
mystical significance.) 

If we now decide to adopt this improved 
rule, it would first affect the year 2048, 
which at the moment is scheduled to be a leap 
year, although of course it should certainly 
not be one. 

If the earth continues to rotate at its 
present rate, the proposed calendar will be 
accurate for 173,000 years. (Actually it slows 
down by one second per day after 500 centuries.) 

(Note: The true period of the earth's 
revolution now is 365 days, 5 hours, 48 minutes, 
45 seconds, and some hundredths of a second. 

We note that 5 hours, 48 minutes, 45 seconds 
divided by 24 hours results in 31/128. Hence 
one leap year dropped from the original Julian 
calendar of 32 such, every 128 years, produces 
almost perfect synchronization.) 
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